Python Job: Senior Python Engineer

Job added on

Company

Frontiers

Location

Berlin - Germany

Job type

Full-Time

Python Job Details

We are on a mission to make science open so everyone can live healthy lives on a healthy planet

Who we are

Frontiers is an award-winning open science platform and leading open access scholarly publisher.

We are one of the largest and most cited publishers globally. To date, our 200,000 freely available research articles have received more than 1 billion views and downloads and 2 million citations. Our journals span science, health, humanities and social sciences, engineering, and sustainability. And we continue to expand into new academic disciplines so more researchers can publish open access.

Be part of the publishing revolution and help us transform the way research is published, evaluated, and communicated to the world.

About the opportunity:

To empower scientists and radically improve how science is published, evaluated and disseminated to researchers, innovators, and the public, we have built our own state-of-the-art

Artificial Intelligence Review Assistant (AIRA). Data is at the heart of AIRA in the form of AIRA Knowledge – a rich graph of academic knowledge such as scientific publications, citation relationships between those publications, as well as authors, institutions and fields of research. This serves as the basis of all the AI/ML models used by our reviewer recommendation service and our quality checks.

We want to keep improving and enriching AIRA with new data sources coming from multiple sources like public web pages, APIs, repositories and external systems.

We are now looking for a passionate Software Engineer, skilled in Python, to join our growing team and help us evolve AIRA Knowledge.

Key Responsibilities:

As a Senior Python Engineer, you will be responsible for optimizing or even re-designing AIRA Knowledge’s data architecture to support our next generation of product features and data initiatives. You will be expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection for AIRA.

Additionally, you will work in our content acquisition pipeline and our new solution for data ingestion and web scraping, defining the architecture and implementing the solution in Python following the best practices.

The ideal candidate is an experienced Python developer that enjoys defining an architecture and building solutions from the ground up, and ideally with some background working in Web Scraping. You will work together with other software developers, data engineers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.

What we are looking for:

  • 3+ years in a similar role
  • Proficient in Python
  • Awareness of software design patterns, clean code principles, full SDLC and the importance of testing
  • Experience with web APIs
  • Understanding of cloud services like Azure, Google Cloud or similar
  • Experience in Docker or similar container technologies
  • Experience in design and develop of scalable data crawlers to extract large volumes of data from the Web.
  • Experience with data crawling techniques and tools (Scrapy, Selenium, Requests, Beautiful Soup)
  • Experience with large-scale systems, software for automation and data-driven apps
  • Good English skills

Your main Responsibilities:

  • Develop small, well-crafted components that plug into our data processing pipeline
  • Write scalable queries that impact millions of rows while keeping execution time low
  • Make improvements to our testing procedure that allow us to move faster and with more confidence
  • Collaborate with data scientists and machine learning experts in order to tacklechallenging problems in a scalable way
  • Work with cutting edge technologies like delta lake to help us provide our users withinnovative tools
  • Build distributed systems for web scraping, data processing

Benefits

With more than 50 nationalities represented in our global team, you will work regularly with teammates in other countries, and with our community of researchers, editors, and authors from around the globe.

Our mission to create solutions for healthy lives also extends to the working environment we provide for our employees.

This includes:

100% remote working

Employees now have the flexibility to choose where they want to work, with remote working available on a part- or full-time basis (not applicable to some Workplace/IT jobs due to nature of role requiring presence onsite, in the office).

Learning and development

All employees have access to LinkedIn Learning (and Pluralsight for our technology team), an annual personal learning budget, and dedicated L&D time.

Wellbeing

We offer free online yoga classes, an employee assistance plan, access to the Headspace app, and four wellbeing days on top of your annual leave allowance.

Volunteering opportunities

Employees can dedicate three days each year to volunteer for a personal cause or through our volunteering partner platform, Alaya.

Frontiers actively embraces diversity and is a safe and welcoming workplace. Recruitment is free from discrimination – including based on race, national or ethnic origin, age, religion, disability, sex, gender identity or sexual orientation. With over 600 employees from more than 50 different nations, our diversity creates vibrant teams and constantly challenges us to appreciate multiple perspectives.

Job Type: Full-time